You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Adds a small TypeScript integration example showing a Restate service handler calling Tuning Engines as an OpenAI-compatible governed AI endpoint.\n\nThe example uses placeholder environment variables only and keeps Restate responsible for durable execution while the gateway handles model routing, policy checks, and trace correlation.\n\nValidation run locally:\n- npm install --ignore-scripts\n- npm run typecheck
Hi, thanks for contributing! I didn't hear about Tuning Engines yet. Could you provide a bit of extra information like a website or so?
Regarding this PR. This repo is for general-purpose examples (not AI ones). Our AI examples live here: https://github.com/restatedev/ai-examples
We don't yet have the structure there to support listing LLM SDKs. That's something that is on the roadmap.
Also, the code doesn't use the Restate SDK for the non-deterministic steps. Both the ID generation and the LLM call need to be wrapped into durable steps, otherwise replay doesn't work.
If you want, you can open a PR in the other repo, and once we have the structure in place, we will merge it.
Thanks again!
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Adds a small TypeScript integration example showing a Restate service handler calling Tuning Engines as an OpenAI-compatible governed AI endpoint.\n\nThe example uses placeholder environment variables only and keeps Restate responsible for durable execution while the gateway handles model routing, policy checks, and trace correlation.\n\nValidation run locally:\n- npm install --ignore-scripts\n- npm run typecheck